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1 Introduction 

There exist several trials to describe chaos appeared in classical or quantum 
dynamical systems [?] . One of the present authors introduced Information Dy- 
namics(ID for short) ^S] as a frame to discuss complexity and chaos appeared 
in various fields, in which he tried to find a common basis by synthesizing the 
state change (dynamics) and the complexity associated with dynamical systems. 
Since then, ID has been applied to several different topics [?], among which a 
chaos degree, a quantity measuring the degree of chaos associated with a dynam- 
ics, was introduced by means of the complexities in ID and its entropic version 
(called Entropic Chaos Degree (EDC for short)) has been computed numerically 
for rather famous chaotic dynamics such as logistic map, baker's transformation, 
Tinkerbel map. It is surprised that the result of the ECD exactly macthes to 
that of Lyapunov exponent in the case that the later can be computed. More- 
over the algorithm computing the ECD is much easier than that of Lyapunov 
exponent, so that the ECD can be almost always computable even when the 
Lyapunov exponent can not be so. However there are some unclear points in 
both conceptually and mathematically why the ECD could be so successful for 
computational experiments. In this paper we study these points and propose a 
new description of chaos. 

In Section 2, we briefly review Information Dynamics and Chaos Degree, 
and in Section 3 the entropic chaos degree and its algorithm are recalled with 
a computational result. In Section 4, a new way judging chaos from a given 
dynamics is discussed based on the ECD, that is, we propose a new view to 
define chaos of dynamical systems. 
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2 Information Dyanamics and Chaos Degree 



We briefly review what ID is. Let (A, 6, ce(G)) be an input (or initial) system 
and (A, 6, 5(G)) be an output (or final) system. Here A is a set of some objects 
to be observed and 6 is a set of some means to get the observed value, a(G) 
describes a certain evolution of system with a parameter g in a certain set G. 
Often we have A = A 1 & = &, a = a, G = G. Therefore it can be said 

[Giving a mathematical structure to input and output triples 
= Having a theory] 

The dynamics of state change is described by a channel, that is, a map 
A*: 6^6 (sometimes 6 — > 6). The fundamental point of ID is that ID 
contains two complexities in itself. Let (At, &t, a*(G*)) be the total system of 
(A, 6, a) and (A,&,a), and S be a subset of 6 in which we are measuring 
observables (e.g., S is the set of all KMS or stationary states in C*-system). 
Two complexities are denoted by C and T. C is the complexity of a state ip 
measured from a reference system <S, in which we actually observe the objects in 
A and T is the transmitted complexity associated with a state change ip — ■> A*(yS, 
both of which should satisfy the following properties : 
(Aximos of complexities) 

(i) For any p e S C 6, 

C s (p) > 0, T s (p;A*) > 

(ii) For any orthogonal bijection j : ex& — ► ex&, the set of all extremal points 
of 6, 

CW(j(<p)) = C s {<p) 
TW(j{<p);A')=T s {<p;A') 

(iii) For $ = tp ip e S t C 6 t , 

C St ($) = C s (<p) + C*(iP) 

(iv) < T s ((p;A*) < C s (ip) 

(v) T s (ip;id) — C s (ip), where "id" is an identity map from 6 to 6. 

Instead of (iii), when "(iii') $ e S t C &t, put <p = $ \ A (i.e., the restriction 
of $ to A), ip = $ \ A, C 5t ($) < C s {ip) + s (ip) " is satisfied, C and T is 
called a pair of strong complexity. Therefore ID is defined as follows: 

Definition 1 : Information Dynamics is described by 

(A, e,a(G):A 7 6, a(G) ; A* ; C s (tp) , T s [ip- A* )) 
and some relations R among them. 
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In the framework of ID, we have to 



(i) mathematically determine 

A6,«(G);A6,«(G), 

(ii) choose A* and R, and 

(iii) define C s (tp), T s (ip;A*). 

In ID, several different topics can be treated on a common standing point 
so that we can find a new clue bridging several fields. 

We assume A = A for simlicity in the sequel. For a certain subset S (called 
the reference space) of 6 and a state tp G S, there exists a decomposition of the 
state (p into a mixture of extreme (pure) states such that 




This extremal decomposition of tp describes the degree of mixture of ip in the 
reference space S. The measure [i is not always unique, so that the set of all 
such measures is denoted by (S) . 

For instance, when (.A, (3) and is a C*-system containing both classical and 
quantum systems; that is, A and is a C* algebra and 6 is the set of all states 
on A, the reference space S is a weak* compact convex subset of 6 and the 
measure pi is not uniquely determined unless S is the Schoque simplex. In this 
paper we will not go to the details of such general mathematical discussion. 

A measure of chaos produced by dynamics A* is defined in |21l 122] : 

Definition 2 is more chaotic than cp if C(ijj) > C(<p). 

(2) When ip e S changes to A*ip, the chaos degree associated to this state 
change (dynamics) A* is given by 

D s ((p; A*) = inf j J C s (A*w) dpi; pi € M v («S) J . 

Definition 3 A dynamics A* produces chaos iff D (ip; A*) > 0. 

It is important to note here that the dynamics A* in the definition is not 
necessarily same as original dynamics (channel) but is one reduced from the 
original one such that it causes an evolution for a certain observed value like 
orbit. However for simplicity we often use the same notation in this paper. In 
some cases, the above chaos degree D s (cp; A*) can be expressed as 

D s (ip; A*) = C s (A» - T s (ip; A*). 
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3 Entropic Chaos Degree and its Algorithm 



Although there exist several complexities |2U], one of the most useful examples 
of C and T are Shannon's entropy and mutual entropy in classical systems 
(von Neumann entropy and quantum mutual entropy in quantum systems 
respectively. 

The concept of entropy was introduced and developed to study the topics 
such as irreversible behavior, symmetry breaking, amount of information trans- 
mission, so that it originally describes a certain chaotic property of state. 

Let us recall the simplest case of C and T, that is, Shannon's entropy and 
mutual entropy. In classical communication systems, an input state ip is a 
probability distribution p = (p^) — ^2 k Pk5k an d a channel A* is a transition 
probability (Uj) , so that the compound state of ip and its output 7p (= p = 
(pj) = A*p) is the joint distribution r — (r^j) with r^j = UjPj. Then the 
complexities C and T are given as 

C(p) = S (p) = - EfePfe iogPfc, 
T(p;A*) = J(p;A*)=E iJ r ij -log^ r . 

Thus the entropic chaos degree of the channel A* becomes 
Definition 4 

D(p;A*) = S(A*p)-I(p;A*). 

Quantum version of the above entropic chaos degree was discussed in |1()II22| . 
on which we will briefly review here in the case of usual Hilbert space expression. 
Let p be a quantum state, namely, a density operator on a Hilbert space TL, and 
A* be a channel sending the set 6 of all states on Ti. into itself. Then the 
entropic chaos degree is defined by 

D(p;A*) =inf l^\ k S (A*E k );{E k } G £ j , 

where £ is the set of all Schatten decompositions (i.e., one dimensional spectral 
decompositions) of the state p := J^k ^kE k , and S is the von Neumann entropy. 

3.1 Algorithm Computing Chaos Degree 

In order to observe a chaos produced by a dynamics, one often looks at the 
behaivor of orbits made by that dynamics, more generally, looks at the behavior 
of a certain observed value. Therefore in our scheme we directly compute the 
chaos degree once a dynamics is explicitly given as a state change of a system. 
However even when the direct calculation does not show a chaos, a chaos will 
appear if one forcuses to some aspect of the state change, e.g., a certain observed 
value which may be called orbit as usual. The algorithm computing the chaos 
degree for a dynamic is the following two cases |211 1221 1121 ITTi] : 
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(1) Dynamics is given by ^ — Ft (x) with x E I = [a, fe] N C R N : First 

find a difference equation x n+ \ = F (x n ) with a map F on / = [a, 6] N C R N 
into itself, secondly let / = lj fc Ak be a finite partation with A, n Aj =0 
(« 7^ j) . Then the state ip^ of the orbit determined by the difference equation 

is defined by the probabilty distribution (p^^j > that is, ip^ = X^Pi™' where 
for a given initial value x E / and the characteristic function 1^ 

m+n 



. .. 'a; 

/c— m 

Now when the initial value x is distributed due to a measure v on /, the above 
(n) • 

p\ ' is given as 



k=m 

The joint distribution between the time n and n + 1 is defined by 



(r k x) i Aj (f^x) 



m+n 



fc= m 

or 

. ra+n 



Then the channel A* at n is determined by 

^(n.ra+l) \ 

>) 



a;=P^)^^ +1) = a>("), 



and the entropic chaos degree is given by the definition 3.1; 

(n) 

D^(a ;; F) = J D A ( p («) ; A;) =E^ )5 ( A ^) = E^r +1)l °g7^TT)- « 

We can judge whether the dynamics causes a chaos or not by the value of D 
as the definition 2.2 



D > chaotic 
D = siaMe. 

This chaos degree was applied to several dynamical maps such logistic map, 
Baker's transformation and Tinkerbel map, and it could explain their chaotic 
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characters. This chaos degree has several merits compared with usual measures 
such as Lyapunov exponent as explained below. 

(2) Dynamics is given by ipt = F^fo on a Hilbert space: Similarly as making 
a difference equation for state, the channel A* at n is first deduced from F't, 
which should satisfy = A* ip( n h By means of this constructed channel 

(a) we compute the chaos degree D directly according to the definition 3.2 or 
(/?) we take a proper observable X and put x n = ip^(X), then go back to the 
algorithm (1). 

Note that the chaos degree D does depend on a partition A taken, which is 
somehow different from usual degree of chaos (cf. , dynamical entropy P [9 
I14p. This is a key point of our understanding of chaos, which will be discussed 
in the next section. 

3.2 Logistic Map 

Let us explain how the entropy chaos degree (ECD) well describes to the chaotic 
bchaivor of logistic map. 

The logistic map is defined by 

x n+1 = ax n (1 - x n ) , x n G [0, 1] , < a < 4 
The solution of this equation bifurcates as shown in Fig. 5.1. 




Fig.l The bifurcation diagram for logistic map 

In order to compare ECD with other measure describing chaos, we take 
Lyapunov exponent for this comparison and remaind here its definition. 
<Lyapunov exponent A(/)> 

(1) Let / be a map on R, and let xq G R. Then the Lyapunov exponent 
Xo (/) for the orbit O = {/" (x ) ; n = 0, 1, 2, • • -}is defined by 

Ao(/)= lim A^(/), A^(/) = ilog 



dx 



(xo) 
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(2) Let / = (/i, f 2 , • • • , f m ) be a map on R m , and let x G R m - The Jacobi 
matrix J„ = £)/" (r ) at r is denned by 



/En ••• Em\ 



J« = Df n (r ) 



Then, the Lyapunov exponent Aq (/) of / for the orbit O = {/" (x ) ; n = 0, 1, 2, • • •} 
is defined by 

Ae> (/) = logMi, Mfc = lim (/x£) » (fc = 1, • • • , m) . 

n — *oo 

Here, /u£ is the &th largest square root of the m eigenvalues of the matrix J„ jj. 



A (/) > Orbit O is chaotic. 
Ao (/) < Orbit O is stable. 

The properties of the logistic map depend on the parameter a. If we take a 
particular constant a, for example, a = 3.71, then the Lyapunov exponent and 
the entropic chaos degree are positive, the trajectory is very sensitive to the 
initial value and one has the chaotic behavior. 
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Fig. 2. Chaos degree for logistic map 
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Fig. 3. Lyapunov exponent for logistic map 

From the above example and some other maps (see the paper |llp. Lyapunov 
exponent and the entropic chaos degree have clear correspondence, but the ECD 
can resolve some inconvenient properties of the Lyapunov exponent as follows: 

(1) Lyapunov exponent takes negative value and sometimes — oo, but the ECD 
is always positive for any a > 0. 

(2) It is difficult to compute the Lyapunov exponent for some maps like Tin- 
kerbell map / because it is difficult to compute f n for large n. On the 
other hand, the ECD of / is easily computed. 

(3) Generally, the algorithm for the ECD is much easier than that for the 
Lyapunov exponent. 

4 New Description of Chaos 

First of all we examine carefully when we say that a certain dynamics produces 
a chaos. Let us take the logistic map as an example. The original differential 
equation of the logistic map is 

dx 

— = ax(l - x),Q < a < 4 (2) 

with initial value Xq in [0,1]. This equation can be easily solved analytically, 
whose solution (orbit) does not have any chaotic behavior. However once we 
make the equation above discrete such as 

x n+ i = ax n (l - x n ),0 < a < 4. (3) 
8 




This difference equation produces a chaos. Taking the discrete time is necessary 
not only to make a chaos but also to observe the orbits drawn by the dynamics. 
Similarly as quantum mechanics, it is not possible for human being to under- 
stand any object without observing it, for which it will not be possible to trace 
a orbit continuously in time. 

Now let us think about finite partition A={Ak; k = 1, • • • , N}of a proper set 
I = [a, 6] N C R N and equi-partition B e = {B e k ; fc = 1, • ■ ■ , N} of /. Here "equi" 
means that all elements Bf. are identical. We denote the set of all partitions by 
V and the set of all equi-partitions by V e . In the section 3, we specify a special 
partition, in particular, an equi-partition for computer experiment calculating 
the ECD. Such a partition enables to observe the orbit of a given dynamics, 
and moreover it provides a criterion for observing chaos. There exist several 
reports saying that one can observe chaos in nature, which are very much related 
to how one observes the phenomena, for instance, scale, direction, aspect. It 
has been difficult to find a satisfactory theory (mathematics) to explain such 
chaotic phenomena. In the difference equation () we take some time interval 
r between n and n + 1, if we take r — > 0, then we have a complete different 
dynamics. If we take coarse graining to the orbit of x t in () for time during r; 
x n = ^ ff^_i\ T Xfdt, we again have a very different dynamics. Moreover it is 
important for mathematical consistency to take the limits n —> oo or N (the 
number of equi-partitions)^ oo , i.e., making the partition finer and finer, and 
consider the limits of some quantities as describing chaos, so that mathematical 
terminologies such as "lim", "sup", "inf" are very often used to define such 
quantities. In this paper we take the opposite position, that is, any observation 
will be unrelated or even contradicted to such limits. Observation of chaos is a 
result due to taking suitable scales of, for example, time, distance or domain, 
and it will not be possible in the limiting cases. 

We claim in this paper that most of chaos are scale- dependent phenomena, 
so the definition of a degree measuring chaos should dependes on certain scales 
taken. 

Taking into cosideration of this view we modify the definitions of the chaos 
degree given in the previous sections as below. 

Going back to a triple (A, 6, a (G)) considered in Section 2 and we use this 
triple both for an input and an output systems. Let a dynamics be described 
by a mapping Ft with a parameter t <E G from 6 to 6 and let an observation 
be described by a mapping O from (A,&,a(G)) to a triple (B,1, [3 (G)). The 
triple (B,%,f3(G)) might be same as the original one or its subsystem and 
the obserevation map O may contains several different types of observations, 
that is, it can be decomposed as O — O m - ■ -Oi.Let us list some examples of 
observations. 

For a given dynamics — F (tp t ) , equivalently, ip t — T^ip, one can take 
several observations. 

Example 5 Time Scaling (Discretizing): O r : t— > n, ^ (t) — > <p n +i, so that 
^ = F(ip t ) => ip n+ i = F(ip t ) and ip t = T* t ip => tp n = T* n tp. Here r is a unit 
time needed for the observation. 
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Example 6 Size Scaling ( Conditional Expectation, Partition): Let (B, X, (3 (G)) 
be a subsystem of (A, &, a (G)), both of which have a certain algebraic structure 
such as C*- algebra or von Neumann algebra. As an example, the subsystem 
(B,%, /3(G)) has abelian structure describing a macroscopic world which is a 
subsystem of a non-abelian (non-commutative) system (A,&,a(G)) describing 
a micro-world. A mapping Oc preserving norm (when it is properly defined) 
from A to B is, in some cases, called a conditional expectation. A typical ex- 
ample of this conditional expectation is according to a projection valued measure 
{P k ; PkPj = PkSkj = P^kj = 0, J2 k Pk = I } associated with quantum, mea- 
surement (von Neumann measurement) such that Oc (p) — Y] k PkpPk f or any 
quantum state (density operator) p. When B is a von Neumann algebra generated 
by {Pk} , it is an abelian algebra isometrically isomorphic to L°° (ft) with a cer- 
tain H aus dor ff space fl, so that in this case Oc sends a general state ip to a prob- 
ability measure (or distribution) p. Similar example ofOc is one coming from a 
certain representation (selection) of a state such as a Schatten decomposition of 
p ; p = Orp = ~^2 k XkEk by one- dimensional orthgonal projections {E k } associ- 
ated to the eigenvalues of p with J^k ^k — I- Another important example of the 
size scaling is due to a finite partition of an underlining space f2, e.g., space of or- 
bit, definedasOp(ty={P k ;P k nP j =P k S kj {k,j = l,---N), uf =1 P k = n} . 

We go back to the discussion of th entropic chaos degree. Starting from a 
given dynamics <p t — T^tp, it becomes <p n = Y* n <p after handling the operation 
O t . Then by taking proper combinations O of the size scaling operations like 
Oc, Or and Op, the equation <p„ = T*<p changes to O (ip n ) = O (T^ip) , which 
will be written by 0(p n = OT* n O- 1 0<p or Lp° n = T* n (p°. Then our entropic 
chaos degree is redifmed as follows: 

Definition 7 The entropic chaos degree of T* with an initial state tp and ob- 
servation O is defined by D° (<p;T*) = j , e ^ S (Y*°oj°) dpP where pP is the 
measure operated by O to a extremal decomposition measure of p selected by of 
the observation O (its part Or). 

Definition 8 The entropic chaos degree of T* with an initial state ip is de- 
fined by D (ip; T*) = inf {D° (tp; T*) ; O G SO} , where SO is a proper set of 
observations natually determined by a given dynamics. 

Then one judges whether a given dynamics causes a chaos or not by the 
following way. 

Definition 9 (1) A dynamics T* is chaotic for an initial state ip in an obser- 
vation O iff D° (ip;T*) > 0. (2) A dynamics T* is totally chaotic for an initial 
state tp iff D{ip;T*) > 0. 

In Definition , SO is determined by a given dynamics and some conditions 
attached to the dynamics, for instance, if we start from a difference equation 
with a special representation of an initial state, then SO excludes O t and Or. 
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The idea introducing in this paper to understand chaos can be applied not 
only to the entropic chaos degree but also to some other degrees such as dy- 
namical entropy, whose applications and the comparison of several degrees will 
be discussed in the forthcoming paper. 

In the caase of logistic map, x n+ \ — ax n (l — x n ) = F (x n ) , we obtain this 
difference equation by taking the observation O t and take an observation Op 
by equi-partition of the orbit space Q = {x n } so as to define a state (probability 
distribution) . Thus we can compute the entropic chaos degree as is discussed in 
Section 3. 

It is important to notice here that the chaos degree does depend on the 
choice of observations. As an example, we consider a circle map 

9 n +l=fv{0n) = n + LJ (mod 2^), (4) 

where u> = 2irv(0 < v < 1). If v is a rational number N/M, then the orbit {9 n } 
is periodic with the period M. If v is irrational, then the orbit {9 n } densely fills 
the unit circle for any initial value 9q] namely, it is a quasiperiodic motion. 
We proved in ^U] the following theorem. 

Theorem 10 Let I = [0, 27r] be "portioned into L disjoint components with equal 
length; I = B x n B 2 n . . . H B L . 

(1) Ifv is rational number N/M , then the finite equi-partition P = {B^', k = 1, • 
impliesD (0q; /„) = 0. 

(2) If v is irrational, then D (8q; /„) > for any finite partition P={Bk}. 

Note that our entropic chaos degree shows a chaos to quasiperiodic circle 
dynamics by the observation due to a partition of the orbit, which is different 
from usual understanding of chaos. However usual belief that quasiperiodic 
circle dynamics will not cause a chaos is not at all obvious, but is realized in a 
special limiting case as shown in the following proposition. 

Proposition 11 For the above circle map, ifv is irrational, then D (do] fv) = 0. 

Proof. Let take an equipartition P — {£?/,} as ■ 

f k — 1 k 1 

B k = < x; 2tt — - — < x < 2 7Ty7r > , k = 1, 2, . . . , I, 

where / is a certain integer and B^+i = Bk- When v is irrational, put v§ = 
[li>] with Gaussian [■] . Then f v (Bj~) intersects only two intervals Bk+ Vo and 
Bk+vo+u so that denote the ration of the Lebesgue measure of f v (Bk)C\ Bk+ Vo 
and that of /^(-Bfc) H Bk+v +i by 1 — s : s. This s is equal to Iv — [lv\ and the 
entropic chaos degree becomes 

D p = -slogs - (1 - s)log(l - s) . 
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Take the continued fraction expasion of v and denote its j-th approximate by 



^ . Then it holds 



1 

< -■ 



For the above equi-partition B = {B^} with I = Cj, we find 



and 

N 

It implies 



\iv-bj\ < ~ 



bj ^when v — ^ > 
6j_i (when — ^ < 



which goes to as j : — > oo. Hence D = inf {-D p ; -P} = OM 

Such a limiting case will not take place in real observation of natural objects, 
so that we claim that chaos is a phenomenon depending on observations, which 
results the definition of chaos above. 

In the forthcoming paper |24| , we will discuss how to reach to chaos dynamics 
by starting from general differential dynamics in both classical and quantum 
systems. That is, it is demonstrated how we can get to chaos dynamics by 
considering observations introduced in this paper, and we calculate the entropic 
chaos degrees in each dynamics. 
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